Apparatus for remotely controlling computers and other electronic appliances/devices using a combination of voice commands and finger movements

ABSTRACT

An apparatus for remotely operating a computer using a combination of voice commands and finger movements. The apparatus includes a microphone and a plurality of control elements in the form of touch-sensitive touchpads and/or motion-sensitive elements that are used to operate the computer and to move an on-screen cursor. At least one touchpad is used to selectively switch between a command-mode of operation in which the computer interprets spoken words as commands for operating the computer and any software applications being used, and a text-mode of operation in which the computer interprets spoken words literally as text to be inserted into a software application. The apparatus is ergonomically designed to enable it to be easily worn and to enable a user to operate a computer from a standing, sitting or reclining position. The apparatus can be used to operate a computer for traditional computing purposes such as word processing or browsing the Internet, or for other purposes such as operating electronic devices such as a television and/or other household appliances. The apparatus eliminates the need for a keyboard and a mouse to operate a computer. In addition, the apparatus can be used as a telephone.

FIELD OF THE INVENTION

The present invention pertains to apparatus for controlling computersand other electronic appliances/devices, and more particularly to anapparatus that uses voice controls and finger movement to remotelycontrol various devices.

BACKGROUND OF THE INVENTION

Computers are widely used throughout the world by businesses, schools,governments, and in homes. Conventional desktop computers are operatedusing a keyboard and mouse, wherein the keyboard is typically used toenter text and commands, and the mouse is typically used for cursornavigation on and graphic control of the computer screen. Althoughconventional keyboards and mouse are typically coupled to a computer viacables, wireless keyboards and wireless mouse which operate overinfrared or radio frequencies are also used to operate computers. Inaddition, for laptop computers, alternative mechanisms for cursornavigation and graphic control of a screen such as touchpads, trackballs, and pointer sticks have been designed.

Conventional keyboards and mouse of the type just described all sufferfrom several drawbacks. Specifically, they must be used together inorder to operate a computer. In addition, most keyboards and mouse mustbe used on a flat horizontal surface. Moreover, due to the small sizeand low resolution of the screens of both desktop and laptop computers,the user must be positioned in close proximity to the screen in order toview the information displayed thereon.

Several recent advances in technology are changing the way conventionalcomputers are used. First, the advent of voice recognition systems whichenable a user to give commands to a computer to insert text into asoftware application by speaking into a microphone is eliminating theneed for keyboards. Second, new ways of viewing computers are beingdeveloped which no longer require the user to be positioned close to astationary screen. These include large, high-resolution, flat-paneldisplays which can be wall-mounted, and goggle and monocle visors whichare worn on the head. Nevertheless, both of these advances suffer fromdrawbacks. Specifically, computers using both voice recognition systemsand high-definition large-screen, flat panel displays still require theuse of a mouse for accurate cursor navigation and for graphic control ofthe screen. In addition, a user must be positioned in a stationaryupright position in order to use the computer, without being able torecline or otherwise move about a room. Another drawback is thatconventional computers and voice recognition systems fail to provide ameans for enabling a computer to distinguish between spoken commandsthat operate the computer or a software application, and spoken textthat is to be inserted literally into a software application. It istherefore an object of the present invention to provide an apparatus forremotely controlling computers and other electronic appliances/devicesusing a combination of voice commands and finger movements, whichapparatus does not require the use of either a keyboard or a mouse.

SUMMARY

An apparatus for remotely operating a computer using a combination ofvoice commands and finger movements. The apparatus includes a pluralityof control elements in the form of touch-sensitive touchpads and/ormotion-sensitive elements that are used to operate the computer and tomove an on-screen cursor. At least one touchpad is used to selectivelyswitch between a command-mode of operation in which a user can issuespoken commands for selecting applications and for instructing thecomputer, and a text-mode of operation in which the user speaks the textto be inserted into an application. The apparatus is ergonomicallydesigned to enable it to be easily worn and to enable a user to operatea computer from a standing, sitting or reclining position. The apparatuscan be used to operate a computer for traditional computing purposessuch as word processing or browsing the Internet, or for other purposessuch as operating electronic devices such as a television and/or otherhousehold appliances.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A shows a top view of an exemplary embodiment of an apparatus forremotely controlling computers and other electronic appliances/devicesaccording to the present invention.

FIG. 1B shows a bottom view of the apparatus shown in FIG. 1A.

FIG. 2 shows a flowchart depicting the steps in using the presentinvention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 shows a top view of an exemplary embodiment of an apparatus 10for remotely operating computers and other electronic appliances/devicesusing a combination of voice commands and finger movements according tothe present invention. FIG. 2 shows a bottom view of apparatus 10.

Apparatus 10 can be used together with voice recognition systems andlarge-screen, flat-panel displays that are included as part a computernetwork to: 1) operate the computer as is traditionally done, e.g., tobrowse the Internet or edit a word processing document; 2) use thecomputer to operate a television; and/or 3) use the computer to operateother electronic appliances/devices. The use of voice recognitionsystems and large-screen, flat-panel displays enables a user to operatethe computer from any position and without having to be in closeproximity to the display, e.g., walking around a room, reclining on achair, etc. The network can include a plurality of large-screen,flat-panel displays, wherein different rooms of a home or office have adisplay so that a user can operate the computer from such rooms.Apparatus 10 can also be used in conjunction with the network to operateheating/air conditioning systems, security systems, etc.

Apparatus 10 is comprised of three finger-shaped sleeves 12, 14 and 16which are coupled together and are designed to be worn like glovesaround the thumb, index and middle fingers, respectively, of a person'shand. Sleeves 12, 14 and 16 can be fabricated from any type of materialand can be constructed in any pattern such as the mesh pattern shown inFIGS. 1A and 1B. Apparatus 10 can be fabricated to have any number ofsleeves which can be worn on any number of fingers. Alternativeembodiments of apparatus 10 can be fabricated to be worn on one or twohands and/or on part of one or two arms.

Apparatus 10 includes an on/off switch 18, a transmitter 20 fortransmitting signals to the computer being operated, and a receiver 22for receiving signals from such computer. Apparatus 10 includes acontrol element in the form of a touch-sensitive thumb touchpad 24,which when held against one of the plurality of other touch-sensitivetouchpads 26, 28, 30, 32, or 34 operates a computer as described below.The functions of a conventional mouse are performed by using touchpads24, 26, and 36 shown in FIGS. 1A and 1B, and 28 and 30 shown in FIG. 1Bto move a cursor on a computer screen used as the graphical interfacefor operating a computer. When thumb touchpad 24 is held against cursoractivator touchpad 26, the cursor movement function on the screen isactivated in the same manner that a cursor on a computer screen comesunder the user's control when they place their hand on a conventionalcomputer mouse.

A motion-sensitive pointer 36 is positioned on thumb sleeve 12 andextends from the top of the first knuckle of the thumb to the tip of thethumb. Moving motion-sensitive pointer 36 while maintaining contactbetween thumb touchpad 24 and cursor activator touchpad 26 causescorresponding movement of the cursor on the computer screen in the samemanner that a cursor on a display screen is moved by moving aconventional computer mouse on a mouse pad.

When index finger touchpad 28 is tapped once against thumb touchpad 24,the object the cursor is pointing to on the computer screen at such timeis activated in the same manner that an object is activated by clickingthe left button of a conventional computer mouse. Tapping index fingertouchpad 28 twice against thumb touchpad 24 is the equivalent ofdouble-clicking the left button of the mouse. If index finger touchpad28 is instead held in continuous contact with thumb touchpad 24, movingmotion-sensitive pointer 36 drags the object selected on the screen to adifferent screen location in the same manner that an object on acomputer screen is selected and dragged by holding down the left buttonof a mouse on the object, dragging the object to a different screenlocation and then releasing the left mouse button. If index fingertouchpad 30 is tapped against thumb touchpad 24, the options for theobject selected by the cursor will be displayed in the same manner thatthe options for an object are displayed on a computer screen by clickingthe right button of a conventional mouse.

A microphone 38 is embedded or otherwise coupled to thumb sleeve 12 ofapparatus 10. When thumb touchpad 24 is held against text-mode touchpad32, the microphone is turned on and engaged in text-mode and any wordsor sounds spoken into microphone 38 by the user are inserted as textinto the application displayed on the computer screen, such as insertingtext into a word-processing document. When thumb touchpad 24 is heldagainst command-mode touchpad 34, the microphone is turned on andengaged in command-mode and any words or sounds spoken into microphone38 by the user are interpreted by the computer as instructions toperform a certain task, such as deleting highlighted text or turning anappliance on or off.

A speaker 40 is coupled to the end of middle finger sleeve 24 so that byplacing the first joint of middle finger sleeve 16 near an ear and thetip of thumb sleeve 12 near their mouth, a user can use apparatus 10 asa telephone. A battery 42 is affixed near the back of index fingersleeve 14 to provide electronic power to different components ofapparatus 10. A scroll touchpad 44 for scrolling up and down the pageson a computer screen is coupled to the back of middle finger sleeve 16.When thumb touchpad 24 is moved up and down against scroll touchpad 44,a user can scroll up and down, respectively, through the pages displayedon the computer screen in the same manner that the recently popularizedscroll wheel of a conventional mouse enables a user to scroll up anddown through the pages displayed on a computer screen.

FIG. 2 shows a flowchart depicting the steps in using apparatus 10 tooperate a computer. At step 1, a person places apparatus 10 on thethumb, index and middle fingers of one hand. At step 2, the user turnsapparatus 10 on using on/off switch 18. At step 3, the user touchesthumb touchpad 24 to command-mode touchpad 34 to activate thecommand-mode operation of the computer. At step 4, the user issues avoice command to open a software application, e.g., Internet browser,word processing document, etc., to be used. At step 5, the user touchesthumb touchpad 24 to cursor activator touchpad 26 to activate thecursor, and while touchpads 24 and 26 are in contact the user usesmotion-sensitive pointer 36 to position the cursor on the computerscreen where text is to be inserted. The user releases thumb touchpad 24from cursor activator touchpad 26 when the cursor has been positionedwhere text is to be inserted. At step 6, the user touches thumb touchpad24 to text-mode touchpad 32 to activate the text-mode operation of thecomputer. At step 7, the user speaks the text to be inserted into theapplication. At step 8, the user touches thumb touchpad 24 to activatethe command-mode touchpad 34 to activate the command-mode operation ofthe computer and issues a voice command to close the application. Atstep 9, the user turns off on/off switch 18 to turn off apparatus 10. Atstep 10, the user removes apparatus 10 from their fingers.Alternatively, the user need not remove apparatus 10, but can wear thesame as a clothing accessory.

The various elements of apparatus 10, such as touchpads 24, 26, 28, 30,32 and 34, motion-sensitive pointer 36, microphone 38, speaker 40,battery 42 and scroll touchpad 44 can each be positioned on any one ofsleeves 12, 14 or 16 such that the operable functions of apparatus 10are implemented differently than in the manner described herein. Forexample, motion-sensitive pointer 36 can be implemented on index fingersleeve 14 rather than on thumb sleeve 12. In addition, apparatus 10 canbe fabricated so that it automatically turns off if it is not used for apredetermined period of time. Also apparatus 10 can be fabricated toinclude a motion sensor enabling apparatus 10 to be turned on and off bythe user snapping his or her fingers or in some other manner.

Apparatus 10 is implemented using conventional hardware and/or softwarewhich enables it to communicate with computers and other electronicappliances/devices. Apparatus 10 is designed to operate computers usingexisting software operating systems, such as Microsoft® Windows®, andexisting software applications, such as Microsoft® Word® or a webbrowser. A user may wear an additional amplification device on the bodyto amplify signals transmitted from or received by apparatus 10.Apparatus 10 can communicate with computers over any frequencies thatpermit wireless, remote communications, including infrared and radiofrequencies. Alternatively, apparatus 10 can be coupled to the computerusing a cable. Apparatus 10 can be used to simultaneously operatemultiple computers and/or appliances/devices. Apparatus 10 can be usedto operate computers and appliances/devices as long as the appropriatedrivers and communication protocols are installed on such computers andappliances/devices.

Apparatus 10 can be used with headgear such as goggles, monocles andglasses that are worn on the head to operate a computer. Apparatus 10can also be used with a stylus and touch-sensitive touch screen tooperate a computer. Apparatus 10 can also be used as a game controller,and can include additional touchpads for playing games. In addition,multiple persons each wearing a separate apparatus 10 can simultaneouslyplay a game or jointly operate an application on the computer.

The aforementioned components comprising apparatus 10 can be fabricatedfrom any material, can be coupled to any one of sleeves 12, 14, and 16,and can be secured to apparatus 10 using any means. Numerousmodifications to and alternative embodiments of the present inventionwill be apparent to those skilled to the art in view of the foregoingdescription. Accordingly, this description is to be construed asillustrative only and is for the purpose of teaching those skilled inthe art the best mode of carrying out the invention. Details of thestructure may be varied substantially without departing from the spiritof the invention and the exclusive use of all modifications which comewithin the scope of the appended claims is reserved.

1. An apparatus for controlling an electric device, comprising: aplurality of finger-shaped sleeves that are coupled together and areeach worn on a different finger of a hand, wherein at least one of theplurality of sleeves has at least one contact-sensitive element forcontrolling an electronic device using finger movements; and amicrophone embedded in one of the plurality of sleeves, wherein theelectronic device is operated using a combination of finger movementsand voice commands.
 2. The apparatus according to claim 1, wherein theplurality of sleeves form a glove and further comprising a microphonecoupled to one of the plurality of sleeves, wherein the electronicdevice is operated using a combination of finger movements and voicecommands.
 3. The apparatus according to claim 1, wherein the at leastone contact-sensitive element is a touch-sensitive touchpad.
 4. Theapparatus according to claim 1, wherein the at least onecontact-sensitive element is a button.
 5. The apparatus according toclaim 1, wherein the apparatus operates the electronic device remotely.6. The apparatus according to claim 5, wherein the apparatus operates atan infrared frequency.
 7. The apparatus according to claim 5, whereinthe apparatus operates at a radio frequency.
 8. The apparatus accordingto claim 1, wherein the apparatus is coupled to the electronic device bya cable.
 9. The apparatus according to claim 1, wherein the electronicdevice is a computer.
 10. The apparatus according to claim 1, whereinthe at least one contact-sensitive element is a motion-sensitive pointerfor moving a cursor on a display device.
 11. The apparatus according toclaim 1, wherein the electronic device is used to operate a television.12. The apparatus according to claim 1, wherein the electronic device isused to operate a household appliance.
 13. The apparatus according toclaim 1, wherein the electronic device is used to operate a computer.14. The apparatus according to claim 1, wherein the apparatus includescommunication means and a speaker enabling the apparatus to be used as atelephone.
 15. The apparatus according to claim 1, wherein the apparatusincludes a receiver for receiving electronic signals from the electronicdevice.
 16. The apparatus according to claim 1, wherein the apparatusincludes a transmitter for transmitting signals to the electronicdevice.
 17. The apparatus according to claim 1, wherein the apparatusincludes a cursor activator touchpad, whereby touching the cursoractivator touchpad activates control of a cursor on a display device.18. The apparatus according to claim 17, wherein the apparatus includesa motion-sensitive pointer used to move the cursor on the displaydevice.
 19. The apparatus according to claim 1, wherein the apparatusincludes a scroll touchpad for scrolling up and down pages displayed ona display device.
 20. The apparatus according to claim 1, wherein theapparatus can be used in conjunction with headgear to operate theelectronic device.
 21. The apparatus according to claim 1, wherein theapparatus can be used in conjunction with a stylus and a touch-sensitivetouch screen to operate the electronic device.
 22. An apparatus forcontrolling an electric device, the apparatus comprising: a plurality offinger-shaped sleeves that are coupled together and are each worn on adifferent finger of a hand, wherein at least one of the plurality ofsleeves has at least one contact-sensitive element for controlling anelectronic device using finger movements; and a microphone embedded inone of the plurality of sleeves, wherein the electronic device isoperated using a combination of finger movements and voice commands; andwherein the contact-sensitive element includes one or both of a (i)text-mode touchpad for instructing a voice recognition system tointerpret spoken words literally as text to be inserted into a softwareapplication displayed on a display device by speaking into themicrophone; or (ii) a command-mode touchpad for instructing a voicerecognition system to interpret spoken words as operating commands forthe electronic device or a software application by speaking into themicrophone.
 23. The apparatus according to claim 22, wherein the atleast one contact-sensitive element is a touch-sensitive touchpad or abutton.
 24. The apparatus according to claim 22, wherein the electronicdevice is configured to operate one or more of a television, a householdappliance, or a computer.
 25. A method for remotely controlling acomputer, comprising the step of: using an apparatus having a pluralityof finger-shaped sleeves that are coupled together and are each worn ondifferent fingers of a hand, the apparatus having a microphone coupledto one of the plurality of sleeves, and the plurality of sleeves eachhaving at least one contact-sensitive element for remotely operating anelectronic device using a combination of finger movements and voicecommands.
 26. The method according to claim 25, wherein the apparatustransmits and receives signals at infrared frequencies.
 27. The methodaccording to claim 25, wherein the apparatus transmits and receivessignals at radio frequencies.
 28. An apparatus for operating a computer,comprising: at least one finger shaped sleeve to be worn on a finger ofa hand for remotely operating a computer using a combination of voicecommands and finger movements, the sleeve including a microphone intowhich a user speaks voice commands and at least one contact-sensitiveelement for selectively switching between a text-mode of operation and acommand-mode of operation.
 29. The apparatus according to claim 28,wherein the user operates the computer in the command-mode to issuespoken commands to the computer by speaking into the microphone.
 30. Theapparatus according to claim 28, wherein the user operates the computerin the text-mode to insert spoken text into an application displayed ona display device by speaking into the microphone.
 31. The apparatusaccording to claim 28, wherein the user uses the at least onecontact-sensitive element to activate control of a cursor on a displaydevice.
 32. The apparatus according to claim 31, wherein the user usesthe at least one contact-sensitive element to move the activated cursor.33. The apparatus according to claim 28, wherein the apparatuseliminates the need to use a keyboard to operate the computer.
 34. Theapparatus according to claim 28, wherein the apparatus enables a user tooperate the computer from a reclining position.
 35. The apparatusaccording to claim 28, wherein the apparatus enables a user to operatethe computer from a seated position.
 36. The apparatus according toclaim 28, wherein the apparatus enables a user to operate the computerfrom a standing position.
 37. The apparatus according to claim 28,wherein the apparatus can be used in conjunction with headgear tooperate the computer.
 38. The apparatus according to claim 28, whereinthe apparatus can be used in conjunction with a stylus and atouch-sensitive touch screen to operate the computer.
 39. The apparatusaccording to claim 28, wherein the apparatus is ergonomically designedto facilitate remote operation of the computer.